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1 A methodology for testing spreadsheets 

Gregg Rothermel , Margaret Burnett , Lixin Li , Christopher Dupuis , Andrei Sheretov 
ACM Transactions on Software Engineering and Methodology (TOSEM) January 2001 
Volume 10 Issue 1 

Spreadsheet languages, which include commercial spreadsheets and various research systems, 
have had a substantial impact on end-user computing. Research shows, however, that 
spreadsheets often contain faults; thus, we would like to provide at least some of the benefits of 
formal testing methodologies to the creators of spreadsheets. This article presents a testing 
methodology that adapts data flow adequacy criteria and coverage monitoring to the task of 
testing spreadsheets. To accommodate ... 

2 Technical papers: software testing: Automated test case generation for spreadsheets 

13 Marc Fisher , Mingming Cao , Gregg Rothermel , Curtis R. Cook , Margaret M. Burnett 
Proceedings of the 24th international conference on Software engineering May 2002 
Spreadsheet languages, which include commercial spreadsheets and various research systems, 
have had a substantial impact on end-user computing. Research shows, however, that 
spreadsheets often contain faults. Thus, in previous work, we presented a methodology that 
assists spreadsheet users in testing their spreadsheet formulas. Our empirical studies have 
shown that this methodology can help end-users test spreadsheets more adequately and 
efficiently; however, the process of generating test cases ... 

3 A generalised spreadsheet verification methodology 
@) Nick Randolph , John Morris , Gareth Lee 

Australian Computer Science Communications , Proceedings of the twenty-fifth 
Australasian conference on Computer science - Volume 4 January 2002 
Volume 24 Issue 1 

Although spreadsheets have been around for over thirty years, we are only just realising their 
importance. Most companies use spreadsheets in their decision-making processes, but rarely 



employ any form of testing. This paper shows how an "all-uses" tescadequacy technique can be 
integrated into Microsoft's Excel. The modular technique adopted makes the implementation 
spreadsheet package independent. It also includes a user interface, to assist developers specify 
test cases and a technique for re . . . 



4 What you see is what you test: a methodology for testing form-based visual programs 97% 
3) Gregg Rothermel , Lixin Li , Christopher DuPuis , Margaret Burnett 

Proceedings of the 20th international conference on Software engineering April 1998 



5 Technical papers: empirical studies I: End-user software engineering with assertions in the 
@) spreadsheet paradigm 

Margaret Burnett , Curtis Cook , Omkar Pendse , Gregg Rothermel , Jay Summet , Chris 

Wallace 

There has been little research on end-user program development beyond the activity of 
programming. Devising ways to address additional activities related to end-user program 
development may be critical, however, because research shows that a large proportion of the 
programs written by end users contain faults. Toward this end, we have been working on ways 
to provide formal "software engineering" methodologies to end-user programmers. This paper 
describes an approach we have developed for support ... 



6 WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation 

Karen J. Rothermel , Curtis R. Cook , Margaret M. Burnett , Justin Schonfeld , T. R. G. Green 
, Gregg Rothermel 

Proceedings of the 22nd international conference on Software engineering June 2000 
Is it possible to achieve some of the benefits of formal testing within the informal programming 
conventions of the spreadsheet paradigm? We have been working on an approach that attempts 
to do so via the development of a testing methodology for this paradigm. Our “What 
You See Is What You Test” (WYSIWYT) methodology supplements the convention by 
which spreadsheets provide automatic immediate visual feedback about values by providing 
automatic immediate visual feedback about &ld ... 
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Searching for PHRASE spreadsheet form based. 

Restrict to: Header Title Order by: Citations Hubs Usage Date Try: Amazon B&N Google (Rl) Google 
(Web) CSB DBLP 

No documents match Boolean query. Trying non-Boolean relevance query. 

1000 documents found. Only retrieving 250 documents (System busy - maximum reduced). Retrieving 
documents... Order: relevance to query. 

Testing Strategies for Form-Based Visual Programs - Rothermel. Li. Burnett (1997) (Correct) 
programming languages, which include electronic spreadsheets and a variety of research systems, have had a 
1997, pages 96 -107 Testing Strategies for Form-Based Visual Programs Gregg Rothermel Department 
www.cs.orst.edu/-grother/papers/issre97.ps.gz 

What You See Is What You Test: A Methodology for.. - Rothermel. DuPuis.. (1998) (Correct) (2 citations) 
programming languages, which include commercial spreadsheets and various research systems, have had a 
You See Is What You Test: A Methodology for Testing Form-Based Visual Programs Gregg Rothermel, Lixin Li, 
www.cs.orst.edu/-grother/papers/icse98-1.ps.gz 

Visual Programming, Knowledge Engineering, and Software Engineering - Menzies (1996) (Correct) 
(e.g. XEROX Star) icon table (e.g. FORMS, spreadsheets) expressions simple forms visual extent 
in increasing order of visual extent: text, simple forms, tables, icons, and diagrams (see Figure 2) 
a traditional textbased approach to a 2-D screen. Based on a survey of current visual programming 
www.sd.monash.edu.au/research/publications/1996/TR96-5.ps 

Object-Oriented Functional Spreadsheets - Clack, Braine (1997) (Correct) 

Object-Oriented Functional Spreadsheets Chris Clack and Lee Braine Department of 

user-defined functions (by allowing cells to be -forms) 3 Is a New Spreadsheet Paradigm Necessary? Our 

declarative spreadsheet which provides a constraint-based environment)the Generalised Spreadsheet Model 

www.dcs.gla.ac.uk/fp/workshops/fpw97/ClackBrainedraft.ps 

Principles for Information Visualization Spreadsheets - Chi. Riedl. al. (1 998) (Correct) (7 citations) 

or columns, and exploring "what-if scenarios. Spreadsheet techniques have recently been extended from 

www-users.cs.umn.edu/-echi/papers/cga98/cga-spreadsheet-principle.pdf 

Modeling Spreadsheet Audit: A Rigorous Approach to Automatic. - Sajaniemi (1998) (Correct) 

Of Computer Science Report Series A Modeling Spreadsheet Audit: A Rigorous Approach To Automatic 

cs.joensuu.fi/pub/Reports/A-1998-5.ps.gz 

Graphical Definitions: Making Spreadsheets Visual through.. - Gottfried, al. (1997) (Correct) (1 citation) 
08855-1331 USA. Graphical Definitions: Making Spreadsheets Visual through Direct Manipulation and 
emphasize that they are a declarative way to define formulas for cells in a graphical manner. The 
ftp.cs.orst.edu/pub/burnett/vl97.gestures.ps.gz 

A Spreadsheet-Based Scripting Environment for SNMP - Kalyanasundaram. Sethi.. (1997) (Correct) (5 citations) 
A Spreadsheet-Based Scripting Environment for SNMP Pramod 

MIB, a scripting language, and event model that form an integral part of the paradigm are presented 

an intermediate manager. This paradigm augments the basic SNMP framework by providing value added 

www.cis.udel.edu/-sethi/papers/97/im97.ps 

A Proposal for a Powerful. Efficient. Algebraic Reduction.. - Wack (1991) (Correct) 

Efficient, Algebraic Reduction, Parallel Spreadsheet Andrew P. Wack February 1991 1 Introduction 

cs.millersv.edu/-wack/Papers/spread-sheet.ps 

Slicing Spreadsheets: An Integrated Methodology for.. - Reichwein. Rothermel. .. (1999) (Correct) 
October 3-5, 1999, pages 25-38. Slicing Spreadsheets: An Integrated Methodology for Spreadsheet 
ftp.cs.orst.edu/pub/burnett/dsl99-afl-reprint-color.pdf 



Collaboration with Spreadsheets - Skip Ellis (Correct) 
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Collaboration with Spreadsheets Skip Ellis &Carlos Maltzahn Department of 
www.cs.colorado.edu/~cariosm/SpreadsheetReport.ps.gz 

Fluid Visualization of Spreadsheet Structures - Igarashi (1998) (Correct) (1 citation) 

1998, p. 118-125. Fluid Visualization of Spreadsheet Structures Takeo Igarashi Dept. of Info. 

augment a visible tabular layout with invisible formulas. Direct manipulations of the tabular layout 

www.parc.xerox.com/istl/members/pollez/papers/fluid-spread-vl98.ps 

Similarity Inheritance: A New Model of Inheritance for.. - Walpole. Burnett (1997) (Correct) 

Inheritance: A New Model of Inheritance for Spreadsheet Languages Rebecca A. Walpole and Margaret M. 

support only ad-hoc reuse through copy/paste and formula replication. Thus spreadsheet users must 

ftp.cs.orst.edu/pub/burnett/TR.lnheritance.ps.gz 

Similarity Inheritance: A New Model of Inheritance for.. - Djang. al. (1998) (Correct) 

Inheritance: A New Model of Inheritance for Spreadsheet VPLs Rebecca Walpole Djang and Margaret M. 

implementation in the research spreadsheet VPL Forms/3. We show that bringing inheritance 

ftp.cs.orst.edu/pub/burnett/vl98.similarity.ps.gz 

Shared Spreadsheet User's Guide - Revision Of (Correct) 

Computer Science University of St Andrews Shared Spreadsheet User's Guide Revision of W6-95) Abstract 
means that the cell has an uncommitted value or formula. Green indicates that you are the only one who 
warp.dcs.st-and.ac.uk/warp/reports/2.3/W1 7-95-ssguide.ps.gz 

Design and Implementation of a Shared Spreadsheet - He Et (Correct) 

St Andrews Design and Implementation of a Shared Spreadsheet Abstract This report describes the design of 
the list of widths of columns. All these objects form the shared context of the spreadsheet. 2.6 
implementaion is more complicated than the latter. Based on this consideration the notion of an Editing 
warp.dcs.st-and.ac.uk/warp/reports/W5-95.ps 

Interpreting Spread Sheet Data for Human-Agent Interactions - All Haller (Correct) 

information source is SC (a standard Unix-based spreadsheet program) spreadsheets. We are attempting to 
directed arcs. These graphs are constrained in the form they may take in the following ways: 1) each node 
information source is SC (a standard Unix-based spreadsheet program) spreadsheets. We are 
archive.cs. umbc.edu/pub/cikm/iia/submitted/viewing/ali. ps 
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